The purpose of the report is to aggregate and examine selected techniques of imputation of missing data in the context of their impact on the prediction efficiency of classification algorithms. The following considerations include various imputation techniques, both basic (median / mode imputation) and more sophisticated (selected methods from the mice, VIM, missRanger and softImpute packages).
For testing purposes, as the classification algorithm, we used the ranger algorithm, which is a fast implementation of random forest, particularly suited for high dimensional data. The prediction effectiveness was assessed in relation to the AUC, balanced accuracy and Matthews correlation coefficient measures.

The report contains, all the results, grouped by both: package and dataset.

ranger

basic (median/mode)

adult

Crossvalidation results

Imputation times

## Imputation time:  0.282

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.78
## Test set MCC:  0.602

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.012

Test set results

## Test set AUC:  0.955
## Test set BACC:  0.888
## Test set MCC:  0.784

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.018

Test set results

## Test set AUC:  0.894
## Test set BACC:  0.838
## Test set MCC:  0.677

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.01

Test set results

## Test set AUC:  0.963
## Test set BACC:  0.833
## Test set MCC:  0.679

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.096

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.927
## Test set MCC:  0.898

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  0.218

Test set results

## Test set AUC:  1
## Test set BACC:  0.986
## Test set MCC:  0.983

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.016

Test set results

## Test set AUC:  0.88
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.021

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.024

Test set results

## Test set AUC:  0.933
## Test set BACC:  0.864
## Test set MCC:  0.774

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.019

Test set results

## Test set AUC:  0.74
## Test set BACC:  0.654
## Test set MCC:  0.316

Missings overview

missRanger

adult

Crossvalidation results

Imputation times

## Imputation time:  32.116

Test set results

## Test set AUC:  0.917
## Test set BACC:  0.78
## Test set MCC:  0.605

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  2.038

Test set results

## Test set AUC:  0.959
## Test set BACC:  0.896
## Test set MCC:  0.796

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  2.416

Test set results

## Test set AUC:  0.922
## Test set BACC:  0.865
## Test set MCC:  0.698

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.644

Test set results

## Test set AUC:  0.944
## Test set BACC:  0.875
## Test set MCC:  0.75

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  9.813

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.917
## Test set MCC:  0.886

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  459.8

Test set results

## Test set AUC:  1
## Test set BACC:  0.98
## Test set MCC:  0.976

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  1.12

Test set results

## Test set AUC:  0.87
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  1.848

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  6.061

Test set results

## Test set AUC:  0.942
## Test set BACC:  0.864
## Test set MCC:  0.774

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.766

Test set results

## Test set AUC:  0.757
## Test set BACC:  0.731
## Test set MCC:  0.5

Missings overview

VIM (knn)

adult

Crossvalidation results

Imputation times

## Imputation time:  99.278

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.778
## Test set MCC:  0.601

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.515

Test set results

## Test set AUC:  0.962
## Test set BACC:  0.895
## Test set MCC:  0.797

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  1.331

Test set results

## Test set AUC:  0.935
## Test set BACC:  0.893
## Test set MCC:  0.777

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.122

Test set results

## Test set AUC:  0.944
## Test set BACC:  0.875
## Test set MCC:  0.75

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  6.086

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.927
## Test set MCC:  0.898

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  241.12

Test set results

## Test set AUC:  1
## Test set BACC:  0.98
## Test set MCC:  0.976

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.42

Test set results

## Test set AUC:  0.917
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.683

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  1.749

Test set results

## Test set AUC:  0.942
## Test set BACC:  0.876
## Test set MCC:  0.793

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.166

Test set results

## Test set AUC:  0.74
## Test set BACC:  0.692
## Test set MCC:  0.404

Missings overview

VIM (hotdeck)

adult

Crossvalidation results

Imputation times

## Imputation time:  0.138

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.779
## Test set MCC:  0.602

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.079

Test set results

## Test set AUC:  0.963
## Test set BACC:  0.895
## Test set MCC:  0.797

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.16

Test set results

## Test set AUC:  0.946
## Test set BACC:  0.816
## Test set MCC:  0.64

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.056

Test set results

## Test set AUC:  0.963
## Test set BACC:  0.917
## Test set MCC:  0.826

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.142

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.907
## Test set MCC:  0.874

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  0.927

Test set results

## Test set AUC:  1
## Test set BACC:  0.984
## Test set MCC:  0.98

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.095

Test set results

## Test set AUC:  0.861
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.101

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.962
## Test set MCC:  0.929

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.191

Test set results

## Test set AUC:  0.933
## Test set BACC:  0.857
## Test set MCC:  0.752

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.064

Test set results

## Test set AUC:  0.751
## Test set BACC:  0.731
## Test set MCC:  0.463

Missings overview

softImpute

adult

Crossvalidation results

Imputation times

## Imputation time:  0.118

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.78
## Test set MCC:  0.602

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.021

Test set results

## Test set AUC:  0.933
## Test set BACC:  0.859
## Test set MCC:  0.716

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.108

Test set results

## Test set AUC:  0.898
## Test set BACC:  0.819
## Test set MCC:  0.623

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.018

Test set results

## Test set AUC:  0.972
## Test set BACC:  0.833
## Test set MCC:  0.679

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.117

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.917
## Test set MCC:  0.886

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  1.07

Test set results

## Test set AUC:  1
## Test set BACC:  0.978
## Test set MCC:  0.974

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.167

Test set results

## Test set AUC:  0.843
## Test set BACC:  0.731
## Test set MCC:  0.525

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.022

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.045

Test set results

## Test set AUC:  0.94
## Test set BACC:  0.876
## Test set MCC:  0.793

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.049

Test set results

## Test set AUC:  0.74
## Test set BACC:  0.692
## Test set MCC:  0.404

Missings overview

mice

adult

Crossvalidation results

Imputation times

## Imputation time:  143.69

Test set results

## Test set AUC:  0.917
## Test set BACC:  0.778
## Test set MCC:  0.601

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  4.1

Test set results

## Test set AUC:  0.965
## Test set BACC:  0.888
## Test set MCC:  0.784

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  1.119

Test set results

## Test set AUC:  0.941
## Test set BACC:  0.829
## Test set MCC:  0.649

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.61

Test set results

## Test set AUC:  0.954
## Test set BACC:  0.875
## Test set MCC:  0.75

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  7.06

Test set results

## Test set AUC:  0.996
## Test set BACC:  0.907
## Test set MCC:  0.874

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  5050.75

Test set results

## Test set AUC:  1
## Test set BACC:  0.982
## Test set MCC:  0.978

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.489

Test set results

## Test set AUC:  0.926
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.619

Test set results

## Test set AUC:  0.997
## Test set BACC:  0.962
## Test set MCC:  0.929

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  32339.37

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.822
## Test set MCC:  0.696

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.159

Test set results

## Test set AUC:  0.722
## Test set BACC:  0.692
## Test set MCC:  0.404

Missings overview

xgboost

basic (median/mode)

adult

Crossvalidation results

Imputation times

## Imputation time:  0.282

Test set results

## Test set AUC:  0.878
## Test set BACC:  0.768
## Test set MCC:  0.565

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.012

Test set results

## Test set AUC:  0.873
## Test set BACC:  0.765
## Test set MCC:  0.528

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.018

Test set results

## Test set AUC:  0.905
## Test set BACC:  0.8
## Test set MCC:  0.574

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.01

Test set results

## Test set AUC:  0.819
## Test set BACC:  0.806
## Test set MCC:  0.611

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.096

Test set results

## Test set AUC:  0.977
## Test set BACC:  0.897
## Test set MCC:  0.874

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  0.218

Test set results

## Test set AUC:  1
## Test set BACC:  1
## Test set MCC:  1

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.016

Test set results

## Test set AUC:  0.778
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.021

Test set results

## Test set AUC:  0.975
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.024

Test set results

## Test set AUC:  0.826
## Test set BACC:  0.78
## Test set MCC:  0.557

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.019

Test set results

## Test set AUC:  0.781
## Test set BACC:  0.692
## Test set MCC:  0.385

Missings overview

missRanger

adult

Crossvalidation results

Imputation times

## Imputation time:  32.116

Test set results

## Test set AUC:  0.881
## Test set BACC:  0.768
## Test set MCC:  0.571

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  2.038

Test set results

## Test set AUC:  0.921
## Test set BACC:  0.825
## Test set MCC:  0.662

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  2.416

Test set results

## Test set AUC:  0.899
## Test set BACC:  0.803
## Test set MCC:  0.568

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.644

Test set results

## Test set AUC:  0.819
## Test set BACC:  0.806
## Test set MCC:  0.611

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  9.813

Test set results

## Test set AUC:  0.977
## Test set BACC:  0.937
## Test set MCC:  0.899

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  459.8

Test set results

## Test set AUC:  1
## Test set BACC:  1
## Test set MCC:  1

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  1.12

Test set results

## Test set AUC:  0.704
## Test set BACC:  0.694
## Test set MCC:  0.354

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  1.848

Test set results

## Test set AUC:  0.975
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  6.061

Test set results

## Test set AUC:  0.828
## Test set BACC:  0.772
## Test set MCC:  0.551

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.766

Test set results

## Test set AUC:  0.781
## Test set BACC:  0.692
## Test set MCC:  0.385

Missings overview

VIM (knn)

adult

Crossvalidation results

Imputation times

## Imputation time:  99.278

Test set results

## Test set AUC:  0.881
## Test set BACC:  0.768
## Test set MCC:  0.57

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.515

Test set results

## Test set AUC:  0.9
## Test set BACC:  0.82
## Test set MCC:  0.646

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  1.331

Test set results

## Test set AUC:  0.913
## Test set BACC:  0.823
## Test set MCC:  0.613

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.122

Test set results

## Test set AUC:  0.819
## Test set BACC:  0.806
## Test set MCC:  0.611

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  6.086

Test set results

## Test set AUC:  0.974
## Test set BACC:  0.913
## Test set MCC:  0.835

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  241.12

Test set results

## Test set AUC:  1
## Test set BACC:  1
## Test set MCC:  1

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.42

Test set results

## Test set AUC:  0.713
## Test set BACC:  0.713
## Test set MCC:  0.426

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.683

Test set results

## Test set AUC:  0.975
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  1.749

Test set results

## Test set AUC:  0.826
## Test set BACC:  0.787
## Test set MCC:  0.575

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.166

Test set results

## Test set AUC:  0.781
## Test set BACC:  0.692
## Test set MCC:  0.385

Missings overview

VIM (hotdeck)

adult

Crossvalidation results

Imputation times

## Imputation time:  0.138

Test set results

## Test set AUC:  0.876
## Test set BACC:  0.743
## Test set MCC:  0.552

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.079

Test set results

## Test set AUC:  0.926
## Test set BACC:  0.838
## Test set MCC:  0.691

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.16

Test set results

## Test set AUC:  0.925
## Test set BACC:  0.794
## Test set MCC:  0.547

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.056

Test set results

## Test set AUC:  0.819
## Test set BACC:  0.806
## Test set MCC:  0.611

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.142

Test set results

## Test set AUC:  0.971
## Test set BACC:  0.924
## Test set MCC:  0.847

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  0.927

Test set results

## Test set AUC:  1
## Test set BACC:  1
## Test set MCC:  1

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.095

Test set results

## Test set AUC:  0.741
## Test set BACC:  0.694
## Test set MCC:  0.354

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.101

Test set results

## Test set AUC:  0.975
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.191

Test set results

## Test set AUC:  0.828
## Test set BACC:  0.791
## Test set MCC:  0.59

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.064

Test set results

## Test set AUC:  0.763
## Test set BACC:  0.731
## Test set MCC:  0.463

Missings overview

softImpute

adult

Crossvalidation results

Imputation times

## Imputation time:  0.118

Test set results

## Test set AUC:  0.878
## Test set BACC:  0.768
## Test set MCC:  0.565

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  0.021

Test set results

## Test set AUC:  0.842
## Test set BACC:  0.817
## Test set MCC:  0.633

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  0.108

Test set results

## Test set AUC:  0.862
## Test set BACC:  0.807
## Test set MCC:  0.566

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.018

Test set results

## Test set AUC:  0.866
## Test set BACC:  0.806
## Test set MCC:  0.611

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  0.117

Test set results

## Test set AUC:  0.985
## Test set BACC:  0.937
## Test set MCC:  0.91

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  1.07

Test set results

## Test set AUC:  1
## Test set BACC:  1
## Test set MCC:  1

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.167

Test set results

## Test set AUC:  0.769
## Test set BACC:  0.569
## Test set MCC:  0.139

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.022

Test set results

## Test set AUC:  0.975
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  0.045

Test set results

## Test set AUC:  0.809
## Test set BACC:  0.76
## Test set MCC:  0.531

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.049

Test set results

## Test set AUC:  0.746
## Test set BACC:  0.692
## Test set MCC:  0.385

Missings overview

mice

adult

Crossvalidation results

Imputation times

## Imputation time:  143.69

Test set results

## Test set AUC:  0.876
## Test set BACC:  0.744
## Test set MCC:  0.551

Missings overview

eucalyptus

Crossvalidation results

Imputation times

## Imputation time:  4.1

Test set results

## Test set AUC:  0.916
## Test set BACC:  0.823
## Test set MCC:  0.666

Missings overview

colic

Crossvalidation results

Imputation times

## Imputation time:  1.119

Test set results

## Test set AUC:  0.891
## Test set BACC:  0.741
## Test set MCC:  0.483

Missings overview

bridges

Crossvalidation results

Imputation times

## Imputation time:  0.61

Test set results

## Test set AUC:  0.866
## Test set BACC:  0.806
## Test set MCC:  0.611

Missings overview

sick

Crossvalidation results

Imputation times

## Imputation time:  7.06

Test set results

## Test set AUC:  0.942
## Test set BACC:  0.873
## Test set MCC:  0.784

Missings overview

SpeedDating

Crossvalidation results

Imputation times

## Imputation time:  5050.75

Test set results

## Test set AUC:  1
## Test set BACC:  1
## Test set MCC:  1

Missings overview

hepatitis

Crossvalidation results

Imputation times

## Imputation time:  0.489

Test set results

## Test set AUC:  0.829
## Test set BACC:  0.694
## Test set MCC:  0.354

Missings overview

vote

Crossvalidation results

Imputation times

## Imputation time:  0.619

Test set results

## Test set AUC:  0.975
## Test set BACC:  0.976
## Test set MCC:  0.953

Missings overview

cylinder-bands

Crossvalidation results

Imputation times

## Imputation time:  32339.37

Test set results

## Test set AUC:  0.775
## Test set BACC:  0.679
## Test set MCC:  0.36

Missings overview

echoMonths

Crossvalidation results

Imputation times

## Imputation time:  0.159

Test set results

## Test set AUC:  0.781
## Test set BACC:  0.692
## Test set MCC:  0.389

Missings overview